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Five problems concerning faculty evaluatioh-are- - 
identified^ along with sever proposed.soltttions.-The-problems are as 
follows: (I) sunmative and ::irmative evaluation objectives are mixed; 
I2i most instt actional evaluation is designed with institutional 
convenience-in mind; 111 evaluation results are given impersonally; 
j[4| most evaluation instruments used are homemade products that have 
not been empirically evaluated; and 15) evgiuation results look 
precise^ objective^ atid meaningfui. These factors contribute 
negatively to faculty attitudesi about evaluation and explain why 
evaluation results teiid not to_be translated into- teaching - 
improvements.: Solutions may- inc^ separating formative and 
summative evaluation but linking the results; allowing the individual 
faculty member to be in control of formative activities;^ 
de-emphasizing the evaluative and judgmental aspects of formative 
activities; promoting the idea that acquiring data on teaching 
behaviors and practices is needed to asstire the integrity of the 
classroom; seeing format ive: evaluation in than _ _ 

standardized machine*^scoi:able f bras ^ encouraging dialogue about 
formative evaluation; and rewarding faculty for instructional 
excellence. (SW) 
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y position as h«id of the 
Ifmructional Develop- 
nieni Pitgranl ^ Rsrtn 
piwidef plenty of 
cppbmmities to interact with faculty 
about ev^IuaUons of their t^kliir^ 
effaiiven^. Th^e^exdiar^^Jend 
support id m^ ccSd^ fic- 
uity h^ bad attitude about instruc- 
tional evaluation in genei^ and 
^dent evaluation in particular. Quite 
bluntly, they do riot like the actnity 
and would riot solicit the evaluaubhs 
if they were hot jr«juired by the insti- 
tutibh. the daia^inake than 6d&h 
sive, even in cases wh«^ the results 
are not aii that bad. 

Second, feciilt>* hav« trouble tmns- 
Mii>g ex'aiuatidn results imo aoidn. 
The results give theiri r\r iridi(3tibri 

what iristructicnial alteraoictfis 
should be implonaited If ihe>* can- 
noi aiKwo-jhe qu^ti^'w^miieec^ 
impcotnenient,** diey change the ques- 
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tion and pose a mudi i«s h^^thy 
query: "How do I get these ratings 
up?" Now tfte move ta change 
irismiaidfial practices is to beriedit 
subsequent ^valuatibris, riot stuc^ts. 
Maybe the change is small, but the 
point is_inipbitanL The mcK^^on to 
teact Secively ^uld not deriw 
prin^dly £rom a desire to win the 
ratir^ gsne. 

When? do these counterproductive 
re^xxises ccxrie from? Is instruction 
evaluated at P^riri State by scMiie per- 
verse system? No, Perin State evalu- 
ai^iastrudidn rauch Uloe imn>vdther 
tn5aib]tions, tn^^be aJbit more s^dn- 
au'catly dian some: Factdty members 
at various junctures in their dodonic 
careers are ^cpeaed to provkie evi- 
^rice of their teadiirig effecdveneB: 
TtK^ system is flexible arid allo^ 
departmeits arid colleges to riiake 
and use their own irisuaimerirs All in 
all, it s typicaL 
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From my bbseivatlbns, th^ 
i^pbnses tend to be quite o^iTunon 
amongficalty^ j^fpes^of ir^m^ 
tionsand diere seem to be fm M- 
tors that cause them. In addition, I 
believe there are seven solutiphs 
^idi, if implemented, would dianp* 
faculty attitudes about partidpatibh in 
evaluation acoviii^ and would 
incre^ the JikelSibbd that ev^u^oo 
results would be translated into 
tQching improvements. 

PROBLEM h Summativc and forma- 
yvc evaluaUbnc^diitiy^^ mixed. 
Summaiive evaluation delink teic^ 
ihg eiidiv^^ with glotsl,^ juclg- 
mentalitems and comp^es the 
instructional competence of one iic- 
uii\' memijer with that erf* others. 
These are the data institutions need 
to make personnel dedsidhs. Fbrmjh 
live evaluations describe teaching in 
behavioral terms and provide diag- 
nc^c input into the^^Svai^iid 
imf^ct c? a set ofinsructional pra:- 
tices. These are the data instruaons 
need to be able to improve. Both 
ev'aiuation t^pes are It^tiitlate and 
nt^essaiy. 

: The pittolem is that you cahhbt get 
both binds with the^ime^bhe. Ybij 
cahhbt Evaluate ih^iic^bn stmrnm- 
i&ely^^e faculty members that data, 
and ej^ea them to improve. 
Rosirdi has dccumented that this 
does not work' and Icgic tells lis wliy. 
For example^ suppose ah item evalu- 
ates the ihstmctbr's attitude towards 
teadiing the cbuise and the m^ is 
low. TlKse^^^l the ir^^cKM- 
ther^ b a_^oblem. They step fer 
shbn of identifying offensive attitudes 



p acuity have bad atti- 
tudes about instruc- 
tiQr^ e\^uatibh . . the 
dam make them defensive, 
even if the results are not 
all bad. 



If rompansoh data do 
not help faculty ideiitify 
areas in need of alteration^ 
and if no opportunities to 
discuss the results are 
provided^ faculty may be 
motivated to b«x)me 
defensive, not 
teachers. 



or making the insinictbr aware of 
behaviors (vid practices th^ convey 
those OTitud^. It is riot surpfeS^ 
th^ S^lty^gimi data !ike thse^are 
in a quand^^ to what they should 
do. The iToindiating taste confronting 
them are legitimatety chaljengipg. 

PROBLEM 2: Mixt ixisthictibisal eval- 
uation is d^gried with ihsdtiitibnsil 
cbriveiiGicc in mirid Ym ri<±aigu- 
ing a^irist admio&tr^ve Sidoiq^ 
However, diis fector does contribute 
to neg^oive Acuity arutudes if it is the 
only ^^'ay evaluatioii information is 
acx?uired To be sure, in^tutiqns 
shcAild collect data for in person- 
riel dedsibris via standard proce- 
dure. But admirustnaiivi (3^^ 
tOTds^iQ be cx>ld and jmpeiK)nal The 
net r^lt is a £aculty member who 
feels that evaluation is something 
done R? him/hef. 

PROBLEM 3. EvaluatiGni resiilis (if 
&culty get diem t»dc) are inuminJ 
vja^kunelquaUy inip»sbiui,ilbdt 
cflkicnt medKxL Generally, nesults 
come tedc to Acuity via die noii — 
"in a plain, brown wrapper irarked 
confidential,** one told uswitfi only a 
small twinkle in his eye^They ome 
(iith varying amounts of sts^iaical 
c\t«7)etics lb decipher and wying 
donees of helpful ih^mdi^^^m^ 
times wdlmean&>g department 
heads try to a^ impeaa to the isults. 
One we know lists sUl sixty £iculty_ 
merhbers b>' the last four digi^ cf 
dieir sbctal securit>' numbers arid 
then rsMik brd«s thiSri fibriii^ to 
tembrriby thdr j^^alL 
gecSmi^ tcLbe on a 
^i^sv^tatm^ JB^g u»ndi from die 
boarari k encoutagii^ And to 
Tirfiat end? the comparison tnoy 
indeed motivate Acuity, but the 



data dbribi help therii identify 
cfficar^in need of alteration, and if 
no cpporruniti© to discuss the 
results are provided, Acuity may be 
motivated to become defensive, hot 
better teadlers. 

PROBLEM 4i: M<^ eyaljuatibri iristrii- 
irieni^ used ar^ homemade ptodacts 
which have not been subjected to 
empiriol evaluation: Seldin ai^ed 
616 insdtudons, "Has your in^tution 
conduaed reseaf d1 on the validity of 
diese fdnns?** 11.2 peitehi responded 
yes.^ EvaluSiori iristhimerits do riot 
autbriiaiically piodub^ good i:&ta. 
Sbrriafiri^ Sej«ulis on b^ niis- 
ieadingand un&h* to die faculty 
member involved. Obviously, person- 
nel decisions t»sed on such data are 
implicated Of ajual ooricem are the 
impsKXs oh die &^tty member who 
niay have felt (righUy or wriDrigly) 
diat all was ^it^ ^11 iri die^class. 
Tb«e dam aare a blow frbrri behind: 
1& fculty jnember's confidence t3 
shaken. And if die data are summati\e 
then, by their very nature, they prcv 
vide little in the way of dues lb die 
prcblehis or sb1utic»is. The pbihi: if 
ail ihstitutibh is going to evaluate fac- 
ulty, the data must be valid arid 
ri^liable. 



raOBt^ 5. Evaioadon results loc^ 
so pmise, so objective, so meaning- 
ful. Hie caicuiation <^ means and 
^ahdard deviations, placemeht in 
percentile grbuj;^, arid cdristructibri 
of fever charts cari occur quite iride- 
p^d^ily of the &^kicAhe^h of 
the instniment diat bzs been used: 
Moreover, numeric representations 
mask the dynamic and variable milieu 
dial is the colle^ classroom. To be 
aire,^ the use of instruciibrial evalua- 
tibri has been arid cbritiriu^ lb be 
r^^rched arid sbriie of the firidiri^ 
are dffiniflve arid civ irrf<OTri the _ 
practices: Bm Se^cience is imprfr 
dse, our instmmenc crude. Unforcu- 
raieljs the computer printout in the 
&cult>' mailbox <toesii*t ^ that Quite 
the cdnu^, it idls a Acuity irieiiiber 
histier cK^erall efedivaiess dri a 7 
point scale is 4.13 ^di obviously 
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make, that faculty membft- better 
than jiis/her colleague with a 4.10 rat- 
ing. That is what the Eaculty rnember 
cbrn^ to believe and that ^cpla&is 
the need to argue so bitterly about 
die results: 

Tjiese fictore cd^ negatively 
to faculty attitudes about the evalua- 
tion enterprise auid eq>lain why eval- 
uation n^ults tend hot to be 
translated into leadiing improve- 
ments: But there is good news — in 
the form of these seven, practical 
solutions. 

SOLUTION 1: Separate ibnnative and 
summative evaluauon activlti^^ but 
link tihc r^ults. Hie jm> aoiviti^ 
should run on separate trade with 
points of convergence at the begin- 
ning and end Summative ev'aiuation 
con^rucLs the comprehensive picture 
of in^ctidilal cdmp^ericy. Fomia- 
tive evaluation closes in on the pic- 
tiire, dissects the cbrhfKDhent parts, 
analj'z^ ihdr rdatiohship l6 one _ 
anciher, identifi© wtiat parts should 
be changed, and provides initial feed- 
back on the success of those changes. 
Surnmative evaluation dccyrs s^n to 
create andUler ram^ite jDiciure, this 
tirne to show the difference. The 
connection between the two carmot 
be bveremph^ized Fbirnaih^e ev^ 
ati^is^uS target appropriate an^ 
of ciange. Summative assessment 
must reflea the impact of those 



Putting Bdilty in charge 
of their improvement 
efforts does not imply that 
they should set out on the 
quest for good teaching 
unaided . . . resources and 
semces must he available. 



SOLUTION 2; Put all formative activ- 
iti« under theii^ and 
die ihdi\idijal £i(mlty jn^ber^ffi 
rationale Ls r^Uy quite sinple: Fac- 
ul^vhave wliat mi^t be eajjed ulti- 
mate iastruaionai prerpgtti\^ 
anj'way. any given day in class, in 
the case of any given alteration^ they 
aTohe decide wtiether or hot to make 
the chan^. This Ls no more than sim- 
ple rea^nition of ihefact tharin^itu- 
dons and individuals cannot force a 
Siculty member to improve. Granted, 
if the sunurcitive t^'aluadon indioites 
the need fen* beaer teauiii^g and die 



faculty member chooses ildi id 
improve, there should tps cbase- 
queiices r^ultihg from that decLsiori, 

Tl>e ficuliy <X)ntrbl advocated Jiere 
^endfe beyond this Je/el of responsi- 
bility to more concrete arenas as 
well. Putting formative aciiviUes 
under the aegi& and contf^ J of the 
faculty m<^ns they get to choose the 
rnethbd of evaluation: bpeh-erided 
questibhnain^, irirormal intei>ie%\« 
y4\h studehtSHSubmission of a video- 
SpS t^diing sample for analj-SB, 
ctesroom oExservation by a coilesgue, 
a program of r<^ding, or whatever. It 
also means that if several areas are 
targeted for improvertierii, the faculty' 
riiemfer selects wtiere to work first. 

All this is predicated upon the 
a^umi^bii dtiat theficult)' member 
will make good dioices: In some 
c^s that czn be a tenuous propRssi- 
tion. But the ad\'antages out^igh the 
risks. Faculty are in cdilirol. That 
decreases dderisivehess. Wore impor- 
tantly, it increase moti\'atibn. The fac- 
ult>' rneml^er acquire ihlbrtratfc)n 
about tesidiing via audible mShods. 
That increases the credibility of the 
results, which iii turn increases the 
chance that they will effea inj^c- 
tior^ practices. 

final note: plittirig faculty in 
charge of their improvement efforts 
does not imply thatth^ .shtxjJd set 
out on the qu»tfor good teidiirig 
unaided, tf an irc^itution is serious 
about its commitment to instructional 
excellence, resources and services 
mu«a be avaiMe to sujpbrt a faculty 
member s efforts to attain iliat goal. 

SOLUTION 3: Dc-ohpliasizc the 
evaluative and judgmoital s^pects of 
foniSttlvc acti\3ti«: Suinrn^ 
assessments e^blish an instructors 
overall tddiing tSecUvenevS. This Ls 
a threaening prtiposition. Pjculty 
^os being wteit thQ* are, adiilLssions 
of fear are unlikeK^ but leluctahce to 



participate may j3rb\^ the point The 

evaluative aspects of surnmative 

aSkS^ment are nbt^ily avoided, but 
^y^ rep^ the emphasis in the form- 
ative reilm? An instruaor does not 
need to know how he/she compares 
with anyone else in order to improve. 
Formatsve activities aun justifiably be 
presented as ways of gettlr>g feedback 
arid acx]uirihg input. Pbrmative evalu- 
^6h ISs faculty inembersAid out 
wfet they'd iBce to feow sfcoot their 
tQcSiing: If that s the agenda and the 
activities are under die control of the 
faculty member, paftidpatibri is a 
much more app^irig prcpbsitibri. 

SOLUTlbN 4: Cultivate die notion 
that acquiring diese kind of data are 
rfd bug deal. This is ilbt to say that the 
activity is uiiimpbrtaht; rather it is tb 
imjDly that acquiririg this sort of 
d^cripiive, diaghcKtjc input Is wtot 
ah>^fadilty rtienibcjr wbnft h&hei- salt 
does on a routine basis: keeping 
cicse tate on tradiing behaviors and 
practices is essential if one hcpes to 
assure the integrity of ^ilai transpires 
in the classrbbrti. 

SOLUTION 5: Think about formative 
evaluation in other ways than sun- 
dardized inacMie-sconibie Jomis. 
When the purpose of e\^uation is to 
get a handle on what is happening in 
an individual cla^ss, the need for 
^piricaily rigoroiis instfUmeriis is 
much less cdrtipelling. Braskamp, 
Braridehbui^ arid Ory point but that 
norms are "considerably impor- 
tant" w?)en imprca'ement Ls the 

agenda:* _ 

Faculty can be encour^ed to con- 
sider other kinds of forms: course • 
material reviews, made-iCHDrdei- 
fontls wliere faculty ( or students, 
provided a faculty rnemh^ Ls basi- 
cally a^Tipeieht arid confident) cbri- 
stnict an iasirumeni from a oollectibri 
of iterrK, or fbrnS^that provide fbi 
rcdprocal feedtedc where the 
dents tell a faculty member sjKctfi- 
cally wliat needs improvement and^ 
the injaructor returns the feedback by 
pn^ding the class with the same sort 
of iipuL" 




_ lalhe formative arena, feculty^(^ 
be enoDara^ to think of activities 
that do not involve instruments. For 
example, faculty can review video- 
taped teaching samples, either their 
own or those belonging id odiers. 
They can visit each others class^— 
not with an evaluation agenda at alJ, 
but simply to see how someone else 
inte^ates computer activities, or skel- 
etal notes, or mini-discussions, or 
wtkatever. ^denis m class be 
interviewed by a colleagv.e, instruc- 
tidrial de\'elc^meht typxi, or trained 
student, and that inTcrmatjoh is 
passed or* to the faculty member^ 
Sne jteratioa of this^^^^roa<S uses 
the Japsffiese mare^ement idea of 
qualit)' circle? to provide regular 
interaction beiw'een the faculty men:- 
ber and students regardmg class mat- 
ters df mutual interest*. The instructor 
can ask directly for students 
re»poh5es:_"rm going to review for 
the .exam nextThurscby: Write me a 
note and jet me know ^tmt topics 
you'd like to ha\'e cov'ered." Feedback 
like tliLs gKHss an instructor some 
sense as to the arieas of cdriierii about 
wiiich students wuy be unclear or 
feel merii ftjriher discussion. That s 
valuable inforrriatioh abouf oiie's 
t^ciiihg. jiftere are many approaches, 
so most faculty members will be able 
to find some approach of interest 
Thus, participation in formatix'e activi- 
ties occurs aiid the facult>' member 
receK'es input that constructively con- 
tribute to imprbvemeht efforts. 

SOJim^ 6: Enc^i^e diaJbgoe 
2dx>ut formative evaluation activities. 
Discussing evaluative data does make 
a difference i|i terms of subsequent 
evtiluatidiis/ Tliat s a dollars aiid cents 
reason to do it, but there are l3i>»er 
Issues. Cla<Ksroc>rris are hot castle> 
vvlio-eone reigas beliind tj^e ckjsed 
door in privac)'. Aademic freedom is 
mi the issue. We are not talking 
rfx)ut Se rig^.ir of the professor to 
make decisions ab(>ut content or 
method Howi^'er, dial(^e 
tt^diirig fecpirdizes mi^k^. l^^^^d, 
axisnicii\'e anah'sis < 



n Listructor does hot 
leed to know how 
he/she eempares with 
anyone e?se in order to 
improve. 



instructional perplexities (like the 
possibility of p>ersonaiized teaching in 
lai^ge classes) and sharing ideas and 
answers irtfuses teadling with a 
steady sburpe of eiiergv* that keeps its 
practice fr«h and vigorous. Evalua- 
tjoti actlvitfe p^c^ide a pSfect 
opix^iTTuniiy to begin the kind of dia- 
logue ^out college t^diing that 
could truly make a difference. 

SOLUTION 7: To the extent tiiat 
chg^ing tn formative evaluation 
activity represents bh-gbihg fitculty 
cbmmitnicnt to instructionaLexcd- 
ience, it otipit to be recognized and 
rewwJei Good teaching doe; not 
happ)en automatically. Fbr mosL fac- 
ulty, it is the result of concerted 
efFoits made th.oughout a teaching 
career. That sort of oh^ing cbmmit- 
meht d^CTves recoghitiba It merits 
rroard \Clien ihsiituliohs prcndde 
reoogniticm and revsard, they extend 
to Sculty powerful rrasons to make 
that commitmeiTt ■ 
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